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THE.  PRO  I 

The  most  successful  type  of  reading  program  for  the 
high  school  is  considered  by  many  reading  authorities  to  be 
an  all-school  program;  that  is,  one  in  which  the  reading 
instruction  is  related  to  other  subject  areas  in  the  school. 
However,  In  an  all- school  program  problems  nay  arise  because 
of  high  school  teachers1  inexperience  in  teaching  the  skills 
of  reading.   One  of  these  problems  is  the  evaluation  of  the 
students'  reading  levels  by  means  other  than  testing.   Such 
evaluation  is  necessary  because  a  good  evaluation  program 
does  not  rely  exclusively  upon  standardized  test  scores. 
Teachers  may  need  to  verify  students1  test  scores  or  they 
may  need  to  gala  more  insight  concerning  students1  problems 
than  can  be  acquired  by  test  scores,   -here fore,  It  seems 
important  to  know  how  accurately  teachers  la  subject  fields 
can  perform  the  task  of  subjectively  evaluating  their  stu- 
dents* reading  levels. 

Statement  of  the  Problem.   The  purpose  of  this  study 
was  to  discover  if  teachers  could  estimate  their  students' 
reading  abilities.  This  was  accomplished  by  determining  the 
relationship  between  teachers'  estimations  of  their  students' 
reading  vocabulary  and  comprehension  levels  and  the  students' 
vocabulary  and  comprehension  scores  on  the  Jiarnostic  Read- 
in-  Test,  Survey  Section.   Since  the  skills  of  comprehension 


2 

and  vocabulary  vary       the  different  subject  fields, 
teachers  of  Tr.'lish,  mathematics,  and  science  were  included 
in  the  study. 

Importance  of  trie  3tudy.  Rosenblatt  commented  on  the 
value  of  reading  by  observing  that  the  printed  page  remains 
the  most  flGxlole  means  through  which  the  individual  man  or 
woman  can  reach  across  physical  and  time  barriers  to  find 
Just  those  other  men  and  women,  remote  |  rhaps  in  time  and 
space,  who  can  offer  needed  knowledge  or  wisdom.   However, 
not  every  man  or  woman  find3  reading  an  easy  task.  The  dif- 
ficulty and  complexity  of  the  reading  act  is  given  evidence 
by  the  failure  of  thousands  of  students  and  adults  to  meet 
the  reading  d  raands  made  upon  them.  Adults  who  have  cc 
1  ted  less  than  five  years  of  schooling  are  considered 
functionally  illiterate,  :since  they  are  unable  to  engage  in 

those  reading  activities  essential  to  the  welfare  of  all 

2 

citizens  in  a  culture.   The  I960  Census  reported  that  two 

per  cent  of  adults  had  zero  years  of  school  completed  and 
eight  per  cent  had  less  than  five  years  of  school  completed. 
The  average  reading  ability  of  adults  was  retorted  to  be 


Hrfilliam  S.  Gray  (ed.),  Reading  in  an  Afte  of  'fess 
Communication,  p.  21. 

2 

•:ry  C.  Austin,  "  .  ro  -ress  Achieved  Thus  i:ar  in 

Develop!     otter  Headers"  (  Setter  headers  rcr  Our  Times. 
ed.  Villi     .  "ray  and  Nancy  Larrick.),  p.  3."" 


tenth  grade. 

The  high  school  Is  unable  to  do  much  about  the  func- 
tionally Illiterate  adults,  but  It  does  have  ■  role  in 
raising  the  reading  levels  cf  students,  to  prevent  their 
being  functionally  illiterate.  The  groundwork  has  been   laid 
and  progress  is  being  made  in  our  high  schools  in  Gianni 
developmental  reading  programs.  Klncheloe  observed  that  not 
too  Ion?  ago  services  were  provided  chiefly  for  the  severely 
handicapped  reader.  Today  we  acknowledge  our  responsibility 

for  providing  instruction  in  the  skills  of  re&ding  for  the 

2 
gifted  also.   Cook  agrees  with  this  observation  in  stating 

that  the  conquest  of  meaning  from  the  printed  page  is  a 

never  ending  challenge  to  the  reader;  and  the  teaching  of 

reading  is  never  done,  but  must  forever  be  faced  anew  where- 

ever  printed  material  is  used  as  a  teaching  resource.   He 

further  states, 

We  have  gone  far  in  preaching  this  gospel;  out, 
like  those  of  our  short-sighted  colleagues  who 
think  that  thr  teaching  of  the  sentence  means  only 
memorising  a  definition  and  reco  nizing  subjects 
and  predicates,  there  are  those  who  think  that 


It, 


".  ' .  Pureau  of  the  Census,  U.  5,  Census  of  Popula- 
tion:  I960 .  Vol .  I ,  Characteristics  o?  the  Population. 
Part  1,  United  states  -unwary,  p.  LII."~ 

^Isabel  Klncheloe,  ''The  Nature  and  Scope  of  Headii 
frgram  Adapted  to  Today1 s  Meeis  in  the  Senior  High  School 
(  letter  headers  For  Our  Times,  ed.  Pilliam  3.  Gray  and  Nancy 
Larrick),  p#  36 # 


children  leam  to  read  in  the  elementary  school 
and  thereafter,  read  to  learn. 

Students  in  high   school  still  read  to  learn,  but 
learning  to  read  does  not  cease  with  the  elementary  grades. 
There  are  many  reading  skills  such  as  skimming  and  critical 
reading  which  can  o   taught  only  in  the  upper  grades.   If 
these  skills  are  not  acquired,  the  student  may  find  groat 
difficulty  in  mastering  subject  matter,   research,  such  as 
that  of  Huth  C.  Penty,  points  out  some  consequences  of  the 
students1  failure  to  master  the  reading  skills,   renty  found 
that  in  the  Battle  Creek  31 gb  School  between  September, 
19J4-7,  and  June,  1951,  the  total  percentage  of  drop-outs  wa3 
over  three  times  as  large  ftJKKBg  the  poor  readers  as  a  among 
the  good  readers;  and  that  during  the  tenth  grade  the  per- 
centage of  drop-outs  was  about  fifteen  times  as  lar^e  for 

2 
the  poor  readers  as  for  the  good  readers.   Through  inter- 
view it  was  found  that  seventy  per  cent  of  the  drop-outs 

reported  trouble  in  reading  and  a  dislike  for  ihose  subjects 

3 
which  required  a  lot  of  reading. 

A  review  of  another  study  may  give  more  insirht  into 


Luella  8.  Cook,  "Chair.  Probleno  Still  to  Be 

Feo       tter  Readers     Pur  T      ed.  Willi an  S.  Gray 
and  *Jancy  Larrick),  p.  57. 

2  uth  C.  Penty,  Ability  and  Hl.-h   ahool  Jrop-Outs. 
P.  P.O. 

3ibid..  p.  $5, 
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why  students  disliked  subjects  which  required  a  lot  of  read- 
ing.  First,  it  was  found  that  the  le^st-liked  subject  among 
poor  readers  was  English.   Annis  analyzed  the  readability 
factors  of  three  novels  commonly  taught  in  high  school  Eng- 
lish classes.   By  using  the  Jale-Chall  and  Flesch  formulas, 
he  found  that  the  average  difficulty  by  grade  level  for  the 
two  formulas  respectively  was:  I van hoe,  grades  eleven  and 
nine;  A  Tale  of  Two  Cities,  grades  ten  and  nine;  and  Silas 

^r::-r.  "re.  !es  eight  fcnd  seven."   If  the  student  is  retdiog 
on  a  sixth  grade  level,  he  will  find  it  difficult  to  read 
any  of  these  novels.  Therefore,  he  may  form  e  dislike  for 
them.   Mso,  If  n?eat  stress  is  placed  upon  his  masteri: 
one  of  those,  he  may  form  a  dislike  for  reading  in  general. 
The  tecche:-  Mho  la  aware  of  a  student's  reading  level  can 

ovide  reading  materials  that  correspond  with  his  level  of 
reading  and  make  the  reading  t&3k  more  pleasant  in  any  of 
the  subject  fields. 

Bents 11  has  made  a  study  in  which  she  used  read- 
ability of  students  for  the  prediction  of  success  in  high 


1Ibld, 

2 

3ell   .   nnls,  "An  Analysis  of  Readability 

Factors  Within  Three  Novels  Commo:       ht  in  Klgb  School" 

(Unpublished  Master's  thesis,  The  University  of  Kansas, 
Lawrence,  1953).  cited  by  Oscar  .      .,      a   ^udies  in 
hicatlon.  10:35.. 
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school.   'he  found  t  .    reliction  equations  based  on  the 
Stanford  Achievement  Test  In  Heading  Indicated  that  success 
in  f^rade  nine  would  require  tent  -   ie  reailn^  in  math- 
ematics, oi '*hth->rade  reading  in     Lish,  eleventh- grade 
roadin-  in  science,  and  ninth-^rade  Mftding  in  social  stud- 
ies.  She  further  stated  that  passing  would  be  likely  to 
occur  even  though  the  reading  were  as  low  as  ^rade  six  in 
mathematics,  ;:rade  four  in  English,  grade  nine  In  science, 
and  grata  six  In  social  studies.   In  ^rade  eleven,  an  elev- 
enth r>:rade  reading  level  appeared  to  correspond  with  success 
in  all  subjects.   Passing  would  probably  occur  even  though 

eral  reading  were  as  low  as  grade  nine  in  "mathematics, 
grade  seven  In  English,  grade  nine  in  science,  and  r^rade 
tight  in  social  studios.   -hie  found  that  students  with 
reading  levels  below  those  predicted  for  passing  would  have 
little  chance  of  doing  satisfactory  course  work.   According 
to  Kottmeyer  a  reading  level  of  seventh  grade  on  a  reliable 
silent-reading  test  indicates  the  minimum  reading  ability 
with  which  a  student  can  deal  passably  with  the  high  school 


race  Sentall,  "Determination  of  Critical  Levels 
of  Reading  Ability  for  High  School  Students  as  Measured  by 
Course  Marks  and  Achievement  Test  Results"  (unpublished 
doctor's  Dissertation,  University  of  hreron,  1961).  Dlsser- 
tatlon  Abstracts.  22*il|59« 


curriculum. 

These  studies  Indicate  the  importance  of  evaluating 
each  students  reading  level  and  having  reading  instruction 
when  it  is  needed.   A.  student  who  does  not  have  the  minimum 
reading  ability  required  by  any  one  subject  field  or  grade 
cannot  be  expected  to  succeed. 

DeBoer  found  that  all  teachers  are  aware  that  their 
pupils  differ  widely  In  reading  ability,  out  few  are  famil- 
iar with  the  astonishing  range  of  the  differences,   ."oat 
pupils  in  American  high  schools  are  grouped  roughly  accord- 
ing to  chronological    .   In  the  typical  eighth  ;?rade  Re  - 
lish  class,  therefore,  a  range  of  eight  or  nore  grades  in 
reading  ability  is  likely.   He  reported  Lazar  as  finding 
amon*-;  more  than  50,0  30  eighth  grade  pupils  only  fourteen  per 
cent  who  had  eighth  grade  reading  ability.  Eight  per  cent 
of  these  pupils  had  less  than  fifth  grade  reading  ability, 

and  almost  seven  per  cent  had  twelfth  grade  reading  ability. 

2 

The  remainder  were  distributed  between  these  two  extremes. 

Other  studies  revealed  similar  wide  rangee  cf  reading 


William  Kottneyer,  "Improving  Reading  Instruction 
in  the  St.  Louis  Schools,"  Llementary  School  Journal.  Ij5i33, 
September,  19UU* 

2 

ohn  J.  Deloer,  "What  Jces  Research  Reveal  About 

Reading  and  the  High  School       ,°"   cited  by  The  National 
Conference  on  Research  in  English,  '.;hai   i  .'•onow  About  'liph 
-  .ool   -.-  ding,  p.  3-  . 
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ability  in  any  one     a.   Penty  found  that  of  2,38)4.  tenth 
grade  students  in  the  lattle  Creek  Hi      loel  between 
September,  1°U7,  KtnA   June,  1951,  the  ran.^e  of  reading  grade 
levels  was  from  I;. 3  to  13.   Likewise,  Kottmeyer  reported  a 
range  from  the  fourth  grade  level  to  the  thirteenth  grade 

level  aaong  .'-!., 23&  eighth  c~rade  graduates  in  the  St.  Louis 

P       3  h 

schools.   3etts  and  Pooley  stated  similar  findings. 

For  the  responsibility  that  this  wide  rar  ~c  of  read- 
ing ability  places  on  the  teacher,  Mobson  cited  itty  as 
statir  , 

All     -school  teachers  face  the  responsibility 
of  ■       assignments  to,  of  utilising  to  a  max- 
imum, and  of  further  dovel^      tht    reading  abilities 
of  students  who  differ  .as  much  a3  six  or  eight  grades 
in  reading  competence. 5 

DeSoer  staJ     bat  the  purpose  should  not  be  to  bring  the 

most  retarded  "up  to  the  norm",  out  to  help  every  child  to 

read  ,     his  full  capacity.  Individual  differences  are 


enty,  00.  cit..  p.  19. 

ottneyar,  0£.  cit..  p.  3U» 

'  mmett  A.  Betts,  "Read!:     ill  ties:   Averages  and 
Deviations,"  '  ducation.  7i|.:32U. 

^Robert  C.   ccley,  "distribution  of  Responsibility 
for  the  Reading  r-  ram,"  (Reading  Ln  •_   -e  of  Mass  Commu- 
nication, ed.  Vllllaa   .  rrj)t    r.  95, 

^Cloy  S.  Hobson,  Teach' n   Y  'dlnn;  in  the   .1  h  chool. 
Part  I,  (Vol.  X.,  To.  1  of    .;""""  ]  cation)  p.  1. 


increased,  not  diminished,  by  f*ood  teaching.   Gates  stated 
that  reading  is  a  very  subtle  art,  and  the  good  teacher  must 
be  an  artist.   He  must  achieve  dec.-  Insight  and  skill  in 

diagnosing  and  teaching  individuals  as  do  successful  teach- 

p 

ers  of  the  other  fine  arts. 

The  teaching  of  reading  on  the  secondary  level  is 
still  so  new  that  excellent,  experienced  teachers  whose 
preparation  was  largely  in  one  subject  field  nay  feel  un- 
qualified to  diagnose  their  students1  reading  levels.  How- 
ever, e  sound  program  of  reading  instruction  can  only  be 
developed  on  the  basis  of  an  accurate  knowledge  of  the  read- 
in  -  status  of  the  students.  At  the  |  resent  time  standard- 
ized reading  tests  are  considered  to  be  the  most  reliable 
means  of  evaluation.  'They  are  usually  administered  at  the 
Inn  inn  and  end  of  the  school  year.   However,  the  job  of 
teaching  reading  calls  for  a  continuous  program  of  evalua- 
tion to  keep  abreast  of  the  students  daily  progress  in 
reading.  There  are  also  schools  in  which  a  formal  program 
of  evaluation  is  not  available,  so  evaluation  depends  upon 
teacriers1  estimates  of  the  students'  reading  abilities. 

According  to  C-lock,  if  the  classroom  teacher  has 


*DeBoer,  o£.  sit.,  p.  39. 

rthur  I.  Gates,      Developing  ir  Levels   of  Read- 

oter.ce,"    (  -ette.      ■<-:■  Un      For      :.r   ".'ir.os.    ed.    ./illiara 
S.  Gray  ai  cy  Larrick),   p.   9r . 
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clearly  in  mind  the  defensible  objectives  tnat  she  wishes  to 
attain  in  her  reading  program,  then  she  can  learn  much  about 
her  pur  lis  through  systematic  observation.  She  can  observe 
symptoms  of  eye  difficulty,  lack  of  motivation,  lip  move- 
ment, and  Inadequacy  of  study  skills.  Through  class  discus- 
sion she  can  learn  much  about  a  pupil's  vocabulary  and  even 
his  personal-social  adjustment  which  is  so  closely  related 
to  effective  reading.   However,  the  important  question  in 
this  study  is  not  how  the  teacher  evaluates.  The  purpose  of 
this  study  was  to  determine  how  well  teachers  can  perform 
the  i-nortcnt  task  of  subjectively  evaluating  their  students* 
reading  comprehension  and  vocabulary  levels. 

REVIEW  OP  THE  LITBRATTJ         VIVO 

TC         .SM 

There  has  been  much  research      *ing  the  validity 
and  usefulness  of  standardized  reading  tests.  In  fact,  they 
receive  *reat  emphasis  as  an  evaluative  measure  in  the  read- 
ing program,  even  though  their  usefulness  is  found  to  be 

p 

limited.    However,  studies  were  found  to  be  limited  which 


"''Ibid.,  p.  133. 

2 

.  Spache,  "Classroom  Techniques  of  Identify- 
ing and  Diagnosing  the  Needs  of  riet  >rded  Readers  in  High 
School  and  College,"  (3etter  '.-■  lers  For  Our  Times.  I  . 
illiam  S.  Gray  and  ^ancy  Larrick),  p.  130. 
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dealt  with  discovering  how  well  the  classroom  teacher  can 
estimate  his  students1  reading  comprehension  ind  vocabulary 
levels.    study  of  the  literature  revealed  that  there  are 
mixed  feelings  regarding  the  classroom  teachers*  ability  to 
evaluate  students*  reading  comprehension  levels.  These 
feelings  seemed  to  be  a  matter  of  opinion  rather  than  based 
upon  evidence. 

Literature  on  Teachers*  *•" valuation  of  Students*  Head- 
ing Levels.  According  to  the  Encyclopedia  of  Educational 
research,  the  methods  used  most  often  for  identification  of 
retarded  readers  are  observation  and  testing.  It  was 
stated, 

'hereas  the  former  has  much  value,  its  limitations 
lie  in  its  subjective  character.  The  use  of  readi 
tests  is  far  more  effective  and  usually  provides  in- 
formation concerning  the  areas  of  greatest  strength 
and  weakness  in  reading. ^ 

Unfortunately,  there  were  no  references  to  specific  studies 

arding  this  statement. 

Fay  reported  a  study  in  which  the  relevant  practices, 

attitudes,  and  observations  of  tight  Har     teachers  using 

Individualized  approaches  to  the  teaching  of  re:     were 

reviewed.  Appraisal  of  the  students'  competence  was  done 

systematically  by  the  teachers.      iardized  reading;  tests 


Chester  W,  Harris  (ed.),  Incycl:pedla  of  : ducational 
Research,  p.  1129 • 
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administered  at  the  beginning  and  end  of  the  school  year 
revealed  an  Improvement  greater  than  would  ordinarily  be 
expected,  "he  teachers*  individualized,  diar^nostic  approach 
to  instruction  was  considered  to  be  effective. 

Hitchcock  approached  this  problem  also  by  correlate 

;  the  teacher's  ratings  and  standardized  te3t  scores,  but 
he  limited  his  study  to  one  English  teacher.  His  study  in- 
volved 101  ei'-hth  grade  pupils  Is  l  lish  in  the  junior  hi 
school  of  KeCookf  Nebraska.  The  ish  teacher  rated  each 
pupil  In  terms  of  grade  placement  in  three  areas  of  reading 
ability:   paragraph  meaning,  word  meaning,  and  average  read- 

•  comprehension.  The  teacher's  ratings  were  based  upon 
el?*ht  criteria.  The  Stanford  Achievement  Test  was  then  ad- 
ministered and  the  results  were  correlated  with  the  ter-ch- 
er's  ratings.  This  correlation  was  found  to  be  so  high  that 
It  was  concluded  that  the  teacher's  ratings  were  nearly  as 

accurate  as  the  test  ratings  and  that  teachers  can  estimate 

2 
the  reading  ability  of  their  students  accurately. 

Hitchcock's  study  was  the  only  study  found  which 

presented  statistical  evidence  of  a  teacher's  ability  to 


XLeo  Fay,  "Basic  Heading  Skills,"  hd neat I on.  62:12 
September,  1961. 

p 

rthur  A.  Hitchcock  and  Cleo  Alfred.  "Can  Teachers 

Mak    curate  Estimates  of  Heading  Ability,   Clearing  House . 
29:>;22-2U,  ''arch,  19r  . 
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evaluate  her  students'  reading  levels,  and  his  study  In- 
volved only  one  English  teacher. 

Oans  stated  that  the  most  effective  ty^e  of  evaluation 
of  reading  is  that  done  by  an  alert  classroom  teacher.  Al- 
though school  wide  ani  systemvd.'Ie  periodic  evaluations  ^ive 
vital  information  required  for  intelligent  program  plannin  , 
continued  wise  personal  guidance  of  each  child  in  a  class- 
room requires  competent  evaluation  by  the  classroom  teach- 
er.  Vain,  no  referral  was  made  to  any  specific  study. 

Limitations  of  .'revious  studies.  Although  one  study 
revealed  the  hi^h  accuracy  with  which  a  teacher  of  English 
could  evaluate  her  stulent's  reading  abilities,  this  cannot 
be  generalized  to  all  teachers  in  all  subject  matter  areas. 
It  cannot  be  assumed  that  a  science  or  mathematics  teacher 
is  as  accurate  as  an  ~n~lish  teacher  in  this  tyre  of  evalua- 
tion, "c  study  was  found  which  measured  the  accuracy  of 
teachers  in  other  subject  areas  In  evaluating  their  stu- 
dents' res.  . "    levels. 


*  .  'ans,  "Good  Teacher — ~cod  Evaluation  of  the  Read- 
'orram,''  Grade  Teacher.  80:23,  vIarch,  1963. 
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MATERIALS  USED  AID  GROUPS  STUDIED  FOR 
THE  PRESENT  STUDY 

The  Jlamostlc  Reading  Test.  Survey  Section.  The 
Diagnostic  Reading  Test,  Survey  Section,  was  the  standard 
used  to  measure  the  ability  of  teachers  to  estimate  their 
students1  reading  levels.  This  test  provides  scores  in 
three  areas  of  reading  ability— o om  rehens ion,  vocabulary, 
and  rate  of  reeding;  however,  only  comprehension  and  vocab- 
ulary were  chosen  as  the  skills  to  be  evaluated  by  teachers 
in  this  study.   It  was  stated  in  The  Fourth  Mental  Measure- 
ments Yearbook  thatt  "In  the  reviewer's  opinion,  the  compre- 
hension, vocabulary,  .  .  .  seem  acceptably  valid  measures." 
The  sections  for  comprehension  consisted  of  reading  material 
similar  to  that  found  in  textbooks  in  social  studies  and 
science.   The  section  for  vocabulary  was  con:;osed  of  sixty 
items  drawn  from  general  vocabulary  and  from  the  vocabularies 
of  English,  mathematics,  science,  and  social  studies.   There- 
fore, the  subject  matter  used  in  the  test  was  similar  to  the 
subject  ^tter  in  the  three  subject  fields  of  English,  math- 
ematics, and  science  used  in  this  study.   The  reliability  of 
the  test  sections  was  .89  for  vocabulary  and  *91  for  compre- 
hension. 


car  i  .   uros  (ed.),  The  Fourth  Mental  Measurements 
Yearbook,   p.  531. 
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Teachers  and  Pupils  Involved  in  the  Study.  Teachers 
of  these  subject  fields  in  grades  nine  and  ten  in  the  Abi- 
lene, Kansas,  public  school  were  involved  in  the  study.  In 
September,  196I4.,  the  Abilene  High  School  principal  consented 
to  make  available  the  necessary  teachers  and  materials  in  his 
school.  It  was  decided  that  the  ninth  and  tenth  grade  teach- 
ers would  take  part  in  the  study  since  their  students  had 
been  rriven  the  Diagnostic  Reading  Test,  Survey  Section,  The 
letter  found  in  Appendix  A,  which  gave  information  to  the 
ninth  and  tenth  grade  teachers  regarding  their  5 art  in  the 
study,  was  sent  to  the  principal  in  October,  196iw  The 
teachers  were  thus  informed  of  the  traits  to  be  rated,  the 
rating  scale,  and  the  time  when  the  rating  was  to  be  com- 
pleted. The  date  set  for  the  teachers  to  make  their  ratings 
was  the  second  week  in  I  ovember,  196!w  They  were  requested 
not  to  consult  the  students'  standardized  reading  test 
scores  before  making  their  estimates. 

total  of  thirteen  teachers  took  (.art  in  the  study. 
Table  I  indicates  the  number  of  teachers  in  each  subject 
field  and  grade  level  who  rated  their  students  in  reading 
comprehension.  The  number  of  students  rated  is  also  indi- 
cated by  grade  and  subject  field.  Table  II  indicates  the 
number  of  teachers  in  each  subject  field,  ^rade  level,  and 
the  number  of  students  that  they  rated  in  reading  vocabulary. 
The  teachers  were  the  same,  except  that  one  teacher  in  tenth 
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TABLE  I 

NUMBER  OP  .    008  PARTICIPATING  AND  NUMBER 
OF  STUDENTS      )  IN  COMPRE 
SUBJECT  FIELD  AND  GRADE  J 


C  o  -rrpre  her.  s  I  on 


Subject 


Irade  level   ".•o.  of  teachers    o.  of  students 


English 

9 

Math. 

9 

Science 

10 

English 

10 

Kath. 

10 

3 
3 
2 
2 
2 


IS* 

120 
U6 
72 
59 


TABLE  II 

NUMBER  OF  TEACHERS  PARTICIPATING  AND  NUM 
OF  STUDENTS  RATED  IN  V0CA3V      3Y 
SUBJECT  FIELD  /     3ADE  LEVEL 


Vocabulary- 


Subject   Grade  level   lo«  of  teachers   No.  of  students 


English 

9 

Xath. 

9 

'  ence 

11 

lish 

10 

Math. 

10 

3 

3 
2 

3 

1 


136 
126 

kk 
96 

39 
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grade  mathematics  and  one  in  tenth  grade  Bhgllsh  did  not 
participate  in  estimating  both  comprehension  and  vocabulary. 
Because  so  few  student  were  enrolled  in  ninth  grade  science, 
the  ninth  grade  science  teacher  was  excluded  from  the  study. 

Data  derived  from  Satin.-:  j  oris  and  Standardized  lest. 
At  the  time  indicated  previously,  rating  forms  were  deliv- 
ered to  the  school.  These  forms  contained  directions  for 
usin~  a  five  point  rating  scale,  the  identification  of  sub- 
ject field,  and  a  list  of  the  students.  It  was  thought 

ortant  that  for  greater  accuracy  the  teachers  rate  the 
students  on  each  trait  separately.  Therefore,  each  teacher 
had  separate  forms  for  rating  students  in  comprehension  and 
vocabulary.  See  Appendix  B  for  the  forms  used  and  Appendix 
C  for  teacher  ratings. 

The  students'  scores  on  the  vocabulary  and  comprehen- 
sion sections  of  the  Diagnostic  Readinn;  lest  were  obtained 
from  the  school  counselor.  This  test  had  been   given  to  the 
students  by  the  counselor  yrior  to  the  present  study.  The 
students1  scores  on  the  Dia^ostic  heading  Test,  Survey  Sec- 
tion, were  then  transformed  into  quintiles  corresponding  to 
the  teacher  rating  scale.  See  Appendix  3  for  data  concern- 
ing test  quintiles. 
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METHOD  AK  _v  Qg 

ethoi  of  Correlation.   In  order  to  measure  the  rela- 
tionship between  the  ratir     iven  the  students  by  the  teach- 
ers on  comprehension  and  vocabulary  and  the  students1  stand- 
ardized test  scores,  contingency  coefficients  were  determined 
for  these  factors  for  each  subject  and  rrade  level.   • ccord- 
Ing  to  'larrett, 

The  coefficient  of  mean  square  contingency,  or 
more  si-iply  the  contingency  coefficient,  was  devel- 
oped parson  in  19014- .  The  contingency 
coefficient,  or  £,  is  based  upon  X^;  but  it  differs 
from  X*  in  that  Tt  provides  a  measure  of  correla- 
tion which  under  certain  conditions  is  coir  arable 
to  the  product-monent  r. 

jett  mentioned  in  the  above  quotation,  there 

are  certain  conditions  which  must  be  met  in  order  to  form  a 

close  relation  of  £  to  r.  He  stated, 

£  is  practically  equivalent  to  r  when  (1)  the 
grouping  is  relatively  fine — $   X  >! fold  or  finer; 
(2)  when  the  sample  :1s  large;  and  (3)  when  we  know, 
or  are  justified  in  assuming,  that  the  characters 
or  attributes  under  investigation  are  normally 
distributed.2 

It  was  believed  that  these  conditions  were  fulfilled  in  this 

study.   First,  the  grouping  was  arranged  in  a  5  X  5  fold 

table.   econd,  the  sample  ranged  from  39  students  to  a  high 


Henry  B,  Barrett,  Statistics  in  Psychology  and 


ducat ion,  p.  367. 

2Ibid..  P.  391 
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of  138  students  In  the  subject  fields,  and  this  number  was 
considered  sufficiently  large.  Third,  in  this  study  It  was 
assumed  that  the  traits  of  reading  vocabulary  and  comprehen- 
sion were  normally  distributed.  In  Appendix  C  will  be  found 
the  5X5  fold  tables  and  the  data  used  in  calculating  the 
contingency  coefficients.  The  formula  used  for  finding  £, 
coefficient  of  contingency,  calculated  directly,  was, 


-  I 


—  1 


S 


Correlation  Results.  The  contingency  coefficients 
determined  for  the  subject  fields  of  ijnglish,  mathematics, 
and  science  by  grade  level  for  the  reading  traits  of  compre- 
hension and  vocabulary  are  presented  In  Table  III.  The  low- 
est contingency  coefficient  determined  was  +.50.  This  rela- 
tionship existed  between  the  ninth  'rade  mathematics  teach- 
er^ estimates  and  pupils'  measured  abilities  in  comprehen- 
sion and  between  tenth  grade  mathematics  teachers  estimates 
and  their  pupils'  measured  ability  in  vocabulary.  The  high- 
est contingency  coefficient  was  +.75.  This  relationship  was 
found  between  ninth  grade  English  teachers'  estimates  and 
lis'  measured  abilities  in  vocabulary. 

According  to  Garrett,  ".  .  .  an  r  from  +  .70  to  +1.00 


1ibia.,  p.  388. 
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TABLE  III 

THE  CC  CY  CCE'FFIC: 

FI  Y  OR/   »E  LEV  KOWIKO 

j.ATIONSHIP   BETWEEK  T:  ' 

AND   PUPILS »  :  LITIE! 


Trait  Comprehension  Vocabulary 

Grade                              9            10  9  10 

lish                      f#SU       +.59  +.75       +.60 

Mathematics              +  .50       +.58  *.65       +.50 

Science  — -  +.51  +.71 


denotes  high  to  very  high  relation,"   Since  the  conditions 
for  which  £  is  practically  equivalent  to  r  were  met  in  this 
study,  a  high  relationship  was  found  to  exist  between  the 
teachers*  estimates  and  pupils  measured  aoilities  in  the 
following  situations: 

1.  Ninth  grade  English  teachers'  ratings  and  pupils' 
measured  ability  in  vocabulary, 

2.  Tenth  grade  science  teachers1  ratings  and  pupils' 
measured  ability  in  vocabulary. 

Oarrott  stated  further  that,  " .  .  .  an  r  from  f.l+O  to 
+#?0  denotes  substantial  or  marked  relationship  .  .  .  . 
Thus,  it  was  found  that  a  marked  relationship  existed  between 
pupils'  scores  on  the  Diagnostic  r:eaiing  Test,  Survey  Sec- 
tion, and  the  teachers'  ability  to  estimate  students'  reading 
ability  in  the  following: 

1.  Sloth  grade  English  teachers'  ratings  and  pupils' 
measured  ability  in  comprehension* 

2.  Tenth  grade  English  teachers'  ratings  and  pupils' 
measured  ability  in  both  comprehension  and  vocabulary. 

3.  TTInth  and  tenth  grade  mathematics  teachers'  rat- 
ings and  pupils'  measured  ability  in  comprehension  and 
vocabulary. 


^•Ibid..  p.  3*4-2,    2Ibid. 
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$4..  Tenth  grade  science      .ors'  rating!  and  pupils' 
measured  ability  in  comprehension. 

Since  a  marked  relationship  loes  exist  between  pu- 
pils' measured  scores  and  the  teachers'  ability  to  estimate 
pupils'  comprehension  and  vocabulary  levels,  teachers  would 
det'   "  e  the  range  of  their      Is'  reading  levels  I 

fust  r,he  subject  matter  to  these         levels  as  sug- 
gested earlier  in  the  study.  They  may  then  be  aole  to  aid 

11  by  teaching  the  reading  skills  as  they  are 
needel . 

SUMMARY 

10  of  this  study  was  to  discover  the  extent 
to  which  high  school  teachers  In  various  subject  fields 
couli  subjectively  estimate  their  students'  reading  levels. 
This  was  accomplished  by  de  term '.nip.      relationship  be- 
tween teachers'  estimates  of  their  students'  reading  levels 
and  the  students'  scores  on  the  Diagnostic  Reading  lest, 

BO t Ion,   The  teachers  who  participated  were  ninth 
and  tenth  grade  teachers  of     ' shf  mathematics,  and  science 
in  Abilene       ohool,    llene,  Kansas.   A  five  point  rat- 
scale  was  used  to  rate  the  students  in  the  reading  skills 
of  comprehension  and  vocabulary.   Contingency  coefficients 
were  then  determined  in  order  to  find  the  relationship  be- 
tween thr  teachers'  estimates  and  pupils'  measured  abilities. 


2J 

A  hl:;h  relationship     'ounl  to  exist  between  the 
teacher'  estimates  ana  pup!"       iur*d  abilities  for  vocab- 
ulary in  ninth  grade  "polish  and  tenth  gFftd*  science,  A 
marked  relationship  existed  between  the  teachers'  estimates 
ana  pupils1  measured  abilities  for  vocabulary  and  comprehen- 
sion in  all  other  areas  studied.   It  was  concluded      &ig- 
lish,  mathematics,  and  science  teachers  can  subjectively 
estimate  their  students*  comprehension  and  vocabulary  read- 

;•  !•▼€     '  th  a  marked  to  a  hi      roe  of  relationship 
with  students T  measured  ability. 
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October  11;,  1961+ 
1913  Casement  Road 
Manhattan,  Kansas 


Mr.  George  Madelen,  Principal 
Abilene  High  School 
Abilene,  Kansas 

Dear  Mr.  Madelen: 

I  would  like  to  express  again  ray  appreciation  for 
your  co-operation  in  allowing  me  to  conduct  a  study  of 
the  teachers'  ability  to  estimate  their  students1  read- 
ing levels  in  your  school.  It  is  my  hope  that  the  re- 
sults of  the  study  will  be  as  meaningful  and  beneficial 
to  you  and  your  teachers  as  it  will  be  for  me. 

The  next  important  step  in  my  study  is  that  of 
informing  the  teachers  of  what  will  be  expected  of  them. 
Because  of  your  familiarity  with  the  teachers  and  the 
convenience  it  will  mean  for  them,  I  would  like  to  ask 
you  to  do  this  for  me.  The  information  to  be  given  to 
them  is  enclosed  in  this  letter.  The  teachers  who  will 
be  involved  in  this  study  are  the  ninth  and  tenth  grade 
English,  mathematics,  and  science  teachers. 

If  more  information  is  needed  or  a  conflict  arises, 
I  shall  be  glad  to  accept  a  collect  telephone  call  at 
PR6-5162  in  Manhattan  or  a  post  card.  I  appreciate  your 
generosity  in  adding  this  task  to  your  busy  schedule. 

Sincerely, 


Joy  Lowe  (Mrs.  E.  B.  Lowe) 
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Information  for  the  Ninth  and  Tenth  Grade 
Teachers  Regarding  the  Estimation  of 
Their  Students'  Reading  Levels 


'o 


1.  3etween  now  and  November,  teachers  should  be  observing 
individual  pupils  to  gain  an  impression  of  the  reading 
vocabulary  and  comprehension  level. 

2.  During  the  second  week  of  November,  teachers  will  be 
asked  to  use  a  five  point  rating  scale  ranging  from 
superior  to  poor  to  rate  each  student  on  the  traits 
given  in  1.  above. 

3.  The  results  of  the  study  will  be  r^ore  valid  and  bene- 
ficial if  scores  on  standardized  tests  are  not  consulted; 
therefore,  it  is  requested  that  teachers  make  their  rat- 
ings without  consulting  the  students1  records. 

1+.  Teachers  will  not  need  to  sign  the  rating  sheets  unless 
they  are  interested  in  obtaining  their  personal  results; 
otherwise,  only  subject  fields  will  be  requested. 

5.  The  co-operation  of  the  teachers  will  be  greatly  appre- 
ciated. 
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TEACHER'S  ESTIMATE  OF  TENTH  GRADE 
STUDENT  VOCABULARY 


Directions : 

On  the  following  pages  is  a  list  of  the  entire  tenth 
grade.   Please  rate  each  student  in  your  classes  according 
to  what  you.  think  his  reading  vocabulary  ability  to  be.   In 
the  space  provided  by  each  student's  name  place  a  numeral 
according  to  the  following  key: 

1  to  indicate  superior  (highest  1/5  of  class) 

2  to  indicate  above  average  (next  to  highest  1/5) 

3  to  indicate  average  (middle  1/5) 

k   to  indicate  below  average  (next  to  lowest  1/5) 
5  to  indicate  poor  (lowest  1/5) 


Check  below  the  subject  field  in  which  the  students 
you  rated  are  enrolled.   If  you  teach  in  more  than  one 
subject  field,  use  a  separate  list  of  students  for  each  one. 

English 

Social  studies 

Mathematics 

Science 

Orientation 
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TEACHER'S  ESTIMATE  OF  TENTH  GRADE 
STUDENT  COMPREHENSION 


Directions : 

On  the  following  pages  is  a  list  of  the  entire  tenth 
grade.   Please  rate  each  student  in  yonr  classes  according 
to  what  you  think  his  reading  comprehensive  ability,  to  be. 
In  the  space  provided  by  each  student's  name  place  a  numeral 
according  to  the  following  key: 

1  to  indicate  superior  (highest  1/5  of  class) 

2  to  indicate  above  average  (next  to  highest  1/5) 

3  to  indicate  average  (middle  1/5) 

4  to  indicate  below  average  (next  to  lowest  1/5) 

5  to  indicate  poor  (lowest  1/5) 


Check  below  the  subject  field  in  which  the  students 
you  rated  are  enrolled.   If  you  teach  in  more  than  one 
subject  field,  use  a  separate  list  of  students  for  each  one 

English 

Social  studies 

Mathematics 

Science 

Orientation 
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TEACHER'S  ESTIMATE  OF  NINTH  GRADE 
STUDENT  VOCABULARY 


Directions : 

On  the  following  pages  is  a  list  of  the  entire  ninth 
grade.   Please  rate  each  student  in  your  classes  according 
to  what  you  think  his  reading  vocabulary  ability  to  be.   In 
the  space  provided  by  each  student's  name  place  a  numeral 
according  to  the  following  key: 

1  to  indicate  superior  (highest  1/5  of  <3lass) 

2  to  indicate  above  average  (next  to  highest  1/5) 

3  to  indicate  average  (middle  1/5) 

4  to  indicate  below  average  (next  to  lowest  1/5) 

5  to  indicate  poor  (lowest  1/5) 


Chack  below  the  subject  field  in  which  the  students 
you  rated  are  enrolled.   If  you  teach  in  more  than  one 
subject  field,  use  a  separate  list  of  students  for  each  one 

English 

Social  studies 

Mathematics 

Science 

Orientation 
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TEACHER'S  ESTIMATE  OF  NINTH  GRADE 
STUDENT  COMPREHENSION 


Directions : 


On  the  following  pages  is  a  list  of  the  entire  ninth 
grade.   Please  rate  each  student  in  your  classes  according 
to  what  you  think  his  reading  comprehensive  ability  to  be. 
In  the  space  provided  by  each  student's  name  place  a  numeral 
according  to  the  following  key: 

1  to  indicate  superior  (highest  1/5  of  class) 

2  to  indicate  above  average  (next  to  highest  1/5 

3  to  indicate  average  (middle  1/5) 

]+  to  indicate  below  average  (next  to  lowest  1/5) 
£  to  indicate  poor  (lowest  1/5) 


Check  below  the  subject  field  in  which  the  students 
you  rated  are  enrolled.   If  you  teach  in  more  than  one 
subject  field,  use  a  separate  list  of  students  for  each  one. 

English 

Social  studies 

Mathematics 

Science 

Orientation 
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NINTH  GRADE  STUDENTS'  TEST  SI  UINTILES 

)   TEACHER  RATINGS  IS  VOCABULARY  AND 
COMPREHENSION  FOR  ENGLISH  A1 

/i-MATICS 
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FIVE  FOLD  TABLE  FOR  STUDENTS*  MEASURED  SCOPES 
A!  RATINGS  C         3  READING 

V0CA3ULARY  IN  NINTH  GRADE 
MATHEMATICS 
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Lower  number  -  Independence  values. 
This  notation  is  used  on  all  5- fold  tables. 
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FIVE  FOLD  TA3LE  FOR  STUDENTS*  )  SCORES 

AND  TEACHER   RATINGS  3  READI! 

VOCABULARY   IN  TENTH  GRADE 
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FIVE  FOLD  TA3LE  FOR   STUDENTS1    MEASURED  SCORES 
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FIVE  FOLD  TAn        STUDENTS*  CORES 
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SCIENCE 


Teacher  Rating 
k  3 
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FIVE  FOLD  TABLE  FOR  STUDENTS1  MEASURED  SCORES 
AND  TEACHER  RATINGS  CONCSRHIKG  READING 
VOCABULARY  IN  TENTH  GHADE 
ENGLISH 
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COMPREHENSION  XI  RUTH  (HUB 
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Teacher  Rating 
k  3 
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(6.81) 

(10.39) 

(13.26) 
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FIVE  FOLD  TABLE  FOR  STUDENTS'  MEASURED  SCORES 
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MATHEMATICS 


Teacher  Rating 
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?h#  purpose   of  this  study  was  to  discover  If 
school  teachers  in  various  subject  fields  could  subjectively 
estimate  their  students'  reading  levels.  This  was  accon*- 
pliahod  by  determining  the  relationship  between  teachers' 
estimates  of  their  a  udents'  reading  levels  and  the  students' 
scores  on  the  Dia;mostic        Test,  Purvey  Lection. 

Thirteen  English,  mathematics,  and  science  teachers 
in  grades  nine  and  ten  in  Abilene,  Kansas,  took  part  in  the 
study.  The  teachers  used  a  five  point  r-:.  ting  scale  ran 
from  superior  to  poor  to  rate  each  student  on  vocabulary  and 
comp returns  ion . 

The  students'  scores  on  the  vocabulary  and  comprehen- 
sion sections  of  the  Diagnostic  Heading  Test,  Purvey  on, 
were  obtained  from  the  school  counselor.  This  test  had  been 

von  to  the  students  by  the  counselor  prior  to  the  present 
stud;.  These  scores  were  then  transformed  into  qulntiles 
corresponding  to  the  teacher  rating  scale. 

In  order  to  measure  the  relationship  between  the  rat- 
ings given  the  students  by  the  teachers  on  comprehension  and 
vocabulary  and  the  students'  sta     Ised  test  scores,  con- 
tingency coefficients  were  determined  for  those  faotors  for 
each  subject  and  grade  level. 

It  was  found  that  a  hi  h  relationship  existed  between 
the  teachers'  estimates  and  pupils  measured  abilities  in  the 


following  situations: 

1.  Ninth  grade    .  ish  teachers  *  ratings  and  pupils' 
measured  ability  in  vocabulary. 

2.  Tenth  grade  science  teacher:*  :     s  and  pupils' 
measured  ability  in  vocabulary. 

A  marked  relationship  existed  between  pupils'  scorea 
on  the  diagnostic  Heading  Test,  Purvey  Section,  and  the 
teachers'  ability  to  estimate  students1  ability  In  the  fol- 
low! r 

1.  TTinth  grade  English  teachers'  ratings  and  pupils' 
measured  a  Ility  in  comprehension. 

2.  Tenth  grade  n relish  teachers'  ratings  and  pupils' 
measured  ability  In      comprehension  and  vocabulary. 

,  MInth  and  tenth  grade  mathematics  teachers'  rat- 
:s  and  pur.  lis »  measured  ability  In  comprehension  and 
vocabulary . 

I}«         I ■  ide  science  teachers'  ratings  a      lis' 
Measured  ability  In  comprehension. 

It  was  concluded  that      ^hf  mathematics,  ■ 
science  teachers  can  suojectively  estimate  their  students' 
comprehension  and  vocabulary  reading  levels  from  a  marked 
to  a      ie^-ree  of  relationship  between  the  students'  meas- 
ured scores  and  teacher  rated  scores. 

nee  a  marked  relations  hip  does  exist  between 


lis*  rjeasured  scores  and  the  teachers'  a  -ility  to  esti- 
mte  pupils*  comprehension  tad  vocabulary  levels,  teachors 
shouli  determine  the  range  of  their  pupils*  reading  levels 

i  eiju.it  the  subject  ~ia-ter  to  these  reading  levels,   -hey 
my      •  able  to  aid  each  .      >y  fee**      ie  read:, 
skills  as  thoy  are  ne«d*d« 


